18.433 Combinatorial Optimization 

Flow Duality and algorithms 

Sept 25, 30 Lecturer: Santosh Vempala 



1 Introduction 

A directed graph is a graph in which every edge has a direction. A capacity is the maximum 
flow allowed on an edge, and is represented by Cjj, where the edge connects the vertices i 
and j in the direction from i to j. 

Given a directed graph G = (V, E), a flow is a collection of paths from a source s € V to a 
sink t € V. The set of edge disjoint paths is the collection of all paths from s to t such that 
no edge appears in more than one path. 

Suppose S is a set of vertices containing s but not containing t. Then S = V — S is the 
compliment of set S. The size of a cut (S, S) is the number of edges from S to S. 

Theorem 1. (Menger) A graph G=(V,E) has k edge disjoint paths from s to t <^=^> k is 
the size of the minimum directed s — t cut. 

Proof. 

(=>) This direction is trivial. 

(<=) Assume this is false. Take the smallest counter example G. So G has minimum cut size 
k but does not contain k edge disjoint paths from s to t. Since G is minimal the removal 
of any edge will induce a graph with a smaller minimum cut. In particular, G contains no 
edges into the source s or out of the sink t as these arcs are not present in any s — t cut. 
We can divide our problem into two cases: 

(i) 3e € E that is not incident to s or t. Now, by the minimality of G, e is contained in 
some minimum cut (S, S). The contraction of the set S gives a graph G' with a minimum 
cut of at least k. Similarly the contraction of the set S gives a graph G" with a minimum 
cut of at least k. Since G was the smallest counterexample, G' has k disjoint paths from s 
to the contracted vertex S whilst G" has k disjoint paths from the contracted vertex S to t. 
These two sets of k edge disjoint paths only coincide on edges within the cut (5, S). Hence 
they may be merged to form k edge disjoint paths from s to t in G. A contradiction. 
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(ii) Every edge is incident to s or t. Arrange the middle vertices (all vertices except s and 
t) into the following two groups: 

1. All vertices who have more edges going in than out, and s. 

2. All vertices who have more edges going out than in, and t. 

Observe that, by definition, the set of edges that go from the first group to the second group 
must contain k edges. It then follows easily that we may find a collection of k edge disjoint 
paths from s to t. □ 

2 The Maximum Flow-Minimum Cut Theorem 

The capacity of a cut (S, S), denoted c(S, S), is equal to the sum of the capacities of each 
edge in the cut whose direction is from S. Let / be a flow from s to t. We will abuse our 
notation and also denote by / the value of the flow. 

Lemma 2. Let (S, S) be any s — t cut in the graph G. Then f < c(S, S). 

Proof. We know that /(a, V) - f(V, s) = f. We also know that f(x, V) - /(V, x) = for 
all x E V — {s, t}. Using this, we can see that f(S, V) — f(V, S) = f . We also know that V 
is equal to the union of S and S. Thus we have f(S, S) — f (S ', S) = f . In conclusion 

f = f(S,S)-f(S,S)<f(S,S)<c(S,S) □ 

In a finite graph there is always a maximum possible flow. Finding this maximum value and 
the flow that attains it can be a very important part of many graph and network problems. 
Suppose we have a graph G = (V,E), where s,t G V are the source and sink, respectively. 
Take a flow / from s to t. Is it the maximum flow? If we look again at Lemma 2, we can 
see that the value of the maximum flow is at most the value of the minimum capacity cut. 
So one way to see if / is maximum is to look for the minimum cut, find it's capacity, and 
compare the values. A better way is to attempt to find an augmenting path for /. Given 
our graph, with source s and sink t, an augmenting path for / is a path {uo,u\, . . . ,u r } 
where: 

1. uo = s. 

2. If (ui,u i+ i) is an edge then f i:i+1 < c^+i. 
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3. If (u i+ i,Ui) is an edge then f i+ i :i > 0. 

We can see that for each vertex in the path, with the exception of s and t, the net flow must 
equal 0. If u r = t, then our augmenting path is a flow augmenting path or f-augmenting 
path, and can be used to increase flow value. 

This leads us to an algorithm for finding max flow that is very similar to the one we used 
to find maximum matching in a graph. 

Algorithm I 
{ 

1) Find an /-augmenting path. 

2) Augment the original flow. 

3) Repeat. 
} 

This algorithm leaves us with a few questions. What is the best way to find an augmenting 
path? Is this process bounded? Is / maximum when an augmenting path does not exist? 
We will answer these questions is reverse order. 

Theorem 3. A flow f is maximum <^=^> there are no flow augmenting paths. 
Proof. 

(=^) Clearly if there is a flow augmenting path then / can not be a maximum flow. 

(<^=) Take the set of vertices Af = {u G V : 3 an augmenting path from s to u.}. Note that 
t ^ Aj as we have no flow augmenting path. Consider the cut (Af, Af). Take an edge (i, j), 
where i G Af and j G Af. Note that for this edge fij = Cij otherwise we could grow Af. 
Similarly fjj = 0. This gives us the the flow across the cut is Yl c i,j ~ 0- We can't send 
anymore than the capacity of the cut, so therefore the flow is maximum if t ^ Af. □ 

Theorem 4. (Max Flow-Min Cut) The maximum flow is equal to the minimum capacity 
cut. 

Proof. Suppose / is the maximum flow value. Therefore the flow / has no augmenting 
paths. Since it has no augmenting paths, the graph contains a cut, given by Af, of capacity 
/. Since no cut can have a capacity less than / the result follows. □. 
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Figure 1: The initial flow. 



3 Algorithmic Efficiency 

The second question to be answered is whether or not the algorithm for finding an aug- 
menting path is bounded. The answer is, not necessarily. If we look at the Figure 1, finding 
the wrong set of augmenting paths will lead to an infinite number of augmentation whose 
augmentation leads to a flow with value less than the maximum flow. The edges have 
extremely large capacities and the initial flow, of value 1 + a + a 2 where a is the root of 
1 — a — o? = 0, is shown in Figure 1. 

To find an augmenting path in this graph, pick a path that starts at s and proceeds to t. 
Find the lowest current flow value on this path, counting only the edges whose direction 
goes against the direction of your path. We do not worry about the edges going in the 
direction of our path, since the capacities of all edges are extremely large. Augment by this 
value. 

For an example, see Figure 2. We may augment this flow by a value a. In the subsequent 
step the situation is similar except that we may find an augmenting path with capacity 
a 2 . In the next step we may augment along a path of capacity a 3 . Observe that we have 
an infinite process. In addition, the limit of the value of the flow obtained is bounded 
(1 + a + a 2 + ^ r>1 c/) whereas the maximum flow can be any value. 
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Figure 2: Augmentation by alpha 




Figure 3: Residual Graph 

4 A Weakly Polynomial Algorithm 

There are better ways to find an augmenting path than by picking a random flow and 
trying to augment it. We can try making a residual graph. A residual graph takes each 
edge and makes it two different edges. Take the edge with capacity Cjj and flow 

fij. The residual graph Res(G) would have two edges between i and j, each with opposite 
directions. Edge has a capacity on it equal to Cjj — fij, while the capacity on edge 
is fcj. If either of the capacities is zero the we will omit the edge from Res(G). If 
there are already two edges of opposite direction connecting the two vertices, then forming 
the residual graph becomes a little more complicated (see figure 3). 

Claim 1. An augmenting path in G corresponds to a directed s - t path in Res(G), and 
therefore and augmenting path in G corresponds to a directed path from s to tin Res(G). 
□ 

This leads us to a new algorithm, similar to the one we were using before. 
Algorithm II 
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{ 

1) Find an s — t path in Res(G) 

2) Augment the flow. 

3) Repeat. 
} 

The problem with this, as with before, is that it depends on picking a good original path to 
augment. How do we make a good choice of path? A good place to start would be to pick 
the path with the maximum capacity. This is a bounded search, a proof of this is asked for 
in the homework. 

Claim 2. A flow / can be decomposed into at most m paths from s to t, excluding cycles. 

Proof of Claim. Every time you create a path, remove the restraining edge in that path 
from the graph. The restraining edge is that whose flow capacity is filled, and thereby holds 
you back from sending any more flow down this path. We can easily induce that there can 
be no more than m paths. □ 

Theorem 5. There is a path P with c(P) > - ' , where f is the current flow value and 
f* is the optimal flow value. 

Proof. Take a graph G, and let /* be the max flow, and / be the current flow. In Res(G) 
you should be able to send /* — / as your max flow. Therefore there exists a path P in 
Res(G) where c(P) > □. 

Now let us examine the running time of the algorithm. We can find a maximum capacity 
path in 0(m) time. Consider the set of augmentations, each with a capacity of at least 
^2^/ ■ There are at most 2m such augmentations. After these augmentations, the remaining 
flow is at most - ^ , since after the augmentations the current maximum capacity path has 
capacity below ^ ' 2 ~ J ' . We can see that the flow remaining halves at most every 2m steps, 
and from this get that the total number of augmentations is at most 2m\og(nU). We then 
have a weakly polynomial running time of 0(m 2 log(nU)). 

5 A Strongly Polynomial Algorithm 

Another way to pick which path to start with when looking for an augmenting path is to 
look for the shortest augmenting path. Start at the source, and look at everything you can 
get to in one step. That is to say, every vertex that is only one edge away. We will call 
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these depth 1. Now find depths 2,3,... in similar fashion. Find the lowest depth to touch 
the sink, and send on it as much as you can send. Now take d(i) to be the level of depth 
of node i. Note that on an edge (i, j) in shortest path from s to t we have d(j) = d(i) + 1. 
The following observation is left as an exercise. 

Observation. The shortest path lengths are non-decreasing in the course of this algorithm. 
Lemma 6. The total number of times an edge can be the minimum capacity edge is 0(n). 

Proof. Suppose the edge (i,j) with capacity j3 is the minimum capacity edge along the 
augmenting path. Augment by j3. Now Res(G) no longer contains the edge (i,j). Before 
the augmentation, at time r say, we had d(j) = d(i) + 1 since we used a shortest path. 
Now, the next time this edge is used the edge (i, j) must again be in Res(G). For this to be 
the case we must, in the meantime have augmented along some path containing the edge 
(j, i). At this point, say at time r', we have d'(i) = d'(j) + 1. Hence d'(i) > d(i) + 2. The 
maximum value of d(i) is n and the theorem follows. Observe also that the total increase 
of d(«)'s over all vertices is less than n 2 , and therefore the total number of augmentations 
is 0(n 2 ). □ 

Since it takes 0(m) time to find a shortest path the running time of this algorithm is 
0(mn 2 ), a strongly polynomial bound. 
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